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Abstract 

We consider the stability of Robust Optimization problems with respect to pertur¬ 
bations in their uncertainty sets. We focus on Linear Optimization problems, including 
those with a possibly infinite number of constraints, also known as Linear Semi-Infinite 
Optimization (LSIO) problems, and consider uncertainty in both the cost function and 
constraints. We prove Lipschitz continuity of the optimal value and e-approximate op¬ 
timal solution set with respect to the Hausdorff distance between uncertainty sets and 
with an explicit Lipschitz constant that can be calculated. In addition, we prove closed¬ 
ness and upper semi-continuity for the optimal solution set mapping with respect to the 
uncertainty set. 


1 Introduction 

The theory and applications of Robust Optimization (RO) have grown rapidly over the 
past two decades. However, one important theoretical property of optimization problems, 
stability, has been largely unexplored in RO with a few notable exceptions. The stability of 
the optimal value and the optimal solution set, with respect to certain problem parameters, 
are examples of the types of stability that are of particular interest in optimization problems. 
For RO problems, one natural quantity that stability can be dehned with respect to is the 
uncertainty set, which is our focus in this paper. 

Before proceeding further, we hrst make a distinction between what we call quantitative 
and qualitative stability. Quantitative stability properties are those that are endowed with 
an explicit constant that describes the degree of stability. One such example is the Lipschitz 
continuity of the optimal value with some constant L, which bounds the change in the 
optimal value by the product of L and some amount of perturbation in the parameters. 
On the other hand, qualitative stability properties are those that do not furnish an explicit 
constant measuring the degree of stability. One example is upper semi-continuity of the 
optimal solution set, which describes the limiting behavior of the optimal solution set without 
providing any information about the rate of convergence. 
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Some RO research has considered stability properties through either a sensitivity analysis 
or problem well-posedness viewpoint. Ben-Tal and Nemirovski [1998 proved a bound on the 
difference in the optimal value between a nominal problem and its robust counterpart, with 
the bound depending on the specific uncertainty set in the robust problem. 


El Ghaoui 


et ah 1998| proved Holder continuity of the approximate optimal solution set in semidefinite 


programming with respect to perturbations in the linear matrix inequality coefficients. More 
recently, Crespi et al. 2015 derived closedness properties for the optimal solution set of a 


robust vector optimization problem. In these papers, the stability results are with respect to 
a fixed uncertainty set. 

Several recent papers have proved convergence properties of RO problems with respect 
to changes in the uncertainty set. In particular, it was shown that the optimal solution 
set (and value) of the robust problem converged to the optimal solution set (and value) 
of the nominal problem as a polyhedral uncertainty set converged to a singleton in robust 
linear programming (Chan and Misic |2013| ). An analogous result was shown for the case of 
general convex uncertainty sets in robust conic programming (Werner |2010| ). These results 
have been extended to the case where a regularized convex uncertainty set converges to a 
non-singleton set in robust quadratic programming (Moazeni et al. 2013|). 


Schultz 


Stability has been well-studied in the related field of Stochastic Programming (see 
2000| for an extensive literature review). In particular, there exist results regarding Lipschitz 


continuity of the optimal value (Liu and Xu 2013|), of the optimal solution sets ( |Romisch 


and Schultz [1996 , Shapiro |1994|, Liu and Xu [2013] ) and approximate optimal solution 


sets (Romisch and Wets~ [^07| ), with respect to the probability measure. Additionally, re¬ 
cent research in Distributionally Robust Stochastic Programming (DRSP) or Distributionally 
Robust Optimization (DRO) stability include convergence of optimal values (and optimal 
solution sets) as the ambiguity sets converge, focusing primarily on uncertainty in the cost 
function (Sun and Xu 2015 , Xu et al. 2012 , Dupacova 2011| ). Quantitative convergence 


of the optimal value has also been established for a two-stage DRSP problem, including 
uncertainty in the constraints (Riis and Andersen 2005| ). 

Stability has also been studied in Linear Semi-Infinite Optimization (LSIO) problems. 


which include the class of robust convex optimization problems (Ben-Tal and Nemirovski 


1998| ). In particular, Canovas et al. |2006b showed Lipschitz continuity of the optimal value 
while Canovas et al. 1999| showed convergence of the optimal solution set. Even though RO 
problems can be viewed as LSIO problems, the above-mentioned properties do not directly 
yield stability properties for RO due to the difference in their problem structures. In these 
LSIO results, the LSIO problems have constraints that are indexed relative to a pre-defined 
and common index set. On the other hand, RO problems have constraints that are typically 
defined by an uncertainty set, which may not constitute a common index set with other RO 
problems. However, as we will show, stability properties for RO can be established by taking 
advantage of the lack of explicit indexing in RO constraints, leveraging existing LSIO results. 

In this paper, we present a comprehensive study of stability, including both quantitative 
and qualitative properties, in robust linear optimization with respect to the uncertainty set. 
In particular, we provide quantitative stability results for the optimal value and e-approximate 
optimal solution set (hereafter abbreviated as e-optimal solution set), and qualitative stability 
results for the optimal solution set. Our results hold for uncertainty in both the cost function 
and constraints. Our results also extend to the case where the nominal problem is a LSIO 
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problem itself, and thus, we establish novel stability results for robust LSIO. Because of the 
connection to robust LSIO, our stability results serve as a stepping stone to understanding 
stability in a general class of robust convex optimization problems. In addition to minor 
technical assumptions, the primary assumptions we make about the underlying RO problem 
are that its uncertainty set is convex and compact, that the strong Slater condition holds, 
and that its optimal solution set is non-empty and bounded. 

The specihc contributions of this paper are: 


Lipschitz continuity of the optimal value. This is the hrst quantitative stability 
result for the optimal value in RO and robust LSIO with uncertainty in the constraints, 
providing an explicit Lipschitz constant that can be calculated from the problem param¬ 
eters. The quantitative nature of this result contrasts with the results for the optimal 


M5| ). 


Chan and Misic 

|2013 , 

Werner 

|2010 , 

Sun and Xu 
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Closedness and upper semi-continuity of the optimal solution set. Under the 
above outlined assumptions, our results relax restrictions such as the type of uncertainty 


set considered ( 

Chan and Misic 

2013 , 

Moazeni et al. 

|2013l) and the specihc form 

or limit of its convergence ( 

Chan and Misic 

2013 , 

Werner |2010|) that are found in 


previous papers. Furthermore, our results hold for both uncertainty in the constraint 


set and cost function, as compared with the results in previous papers (Moazeni et al 


2013|, Sun and Xu 2015|) which only include uncertainty in the cost function 


3. 


Lipschitz continuity of the e-optimal solution set. This is the hrst quantitative 
stability result for the e-optimal solution set in RO and robust LSIO, for which not 
even qualitative stability results have been established yet. Our proof leverages a 
similar result from variational analysis (Rockafellar and Wets |2009|). 


The rest of the paper is organized as follows. In Section]^ we review relevant background 
and introduce our notation. The main stability results we prove require two things: hrst, 
a mapping between RO and LSIO problems, which we develop in Section and second, a 
guarantee of invariance of the Lipschitz constant for equivalent LSIO problems, which we 
prove in Section Finally, we prove the desired RO and robust LSIO stability results of 
Lipschitz continuity of the optimal value in Section]^ set convergence of the optimal solution 
set in Section and Lipschitz continuity of the e-optimal solution set in Section The 
Appendix contains helpful technical results. While some of these results have been used 
implicitly in other papers such as Canovas et al. 2006b| , we include them here with proofs 
for ease of reference. 


2 Preliminaries 
2.1 Notation 

We write int(A), bd(A), cl(y4), and ext(y4) to denote the interior, boundary, closure, and 
exterior of a set A. The appropriate topology or metric space for these dehnitions will be 
clear in context. We dehne conv(A) and cone(A) as the convex hull and conical hull of A, 
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respectively. Given a metric d on a metric space X, we define the distance between a point 
X and a set ^4 C X as d{x,A) := iniyfz a d{x,y). If X is additionally a normed vector space 
with norm || ■ || and d is associated with the norm || ■ ||, we can also analogously denote d* 
as the dual norm of d. Also, let Xa{x) denote the characteristic function with Xa{x) = 0 if 
X E A and Xa{x) = +oo otherwise. Let B{xo,e) denote the ball in the appropriate metric 
space of radius e centred at xq. Let B := B{0, 1) denote the unit ball. 


2.2 Linear Semi-Infinite Optimization Problems 


In this section, we present the LSIO concepts that are most relevant to our development. 


Much of the concepts and notation are adapted from Canovas et ah 

2006b| and related 

papers ( 

Canovas et al. 

|2005 


1999 , 

Lopez 

120121). 


2.2.1 Formulation and Related Quantities 

A Linear Semi-Infinite Optimization problem takes the form; 

inf (c, x) 
a;eM" 

subject to {at,x) > bt, Wt G T, 

where the (■, ■) denotes the dot product in M”. Here, c is the cost function, at are the 
coefficient vectors indexed by t, and bt are the right-hand side values. The set T is possibly 
uncountably infinite, with no assumed topological structure. It is helpful to think of the 
coefficients and right-hand sides as functions, namely, a : T —)■ M"’ with a : t h->• a* and 
6 : T —)■ M with b : t eE- bt- 

We denote tt := (c, a) as the tuple that uniquely defines a LSIO problem of the form ([^. 
Further, we write a := {a,b) as the constraint system of tt, that is, tt := (c, (a, 6)) = (c, a). 
Different LSIO problems will be indexed by j and written Tij = (G, {a^ ,V)) = {c^,aj). We 
denote H := M" x S as the collection of all LSIO problems, where E := (M" x M)^ is the 
collection of all constraint systems (both feasible and infeasible). 

A problem vr = (c, a) has a feasible solution set, an optimal value, an optimal solution 
set and, for some given e > 0, an e-approximat^ optimal solution set, which are denoted as: 

F{a) := {x eW^ : {at,x) >bt, yt eT}, 
u(7i) := inf |(c,x) : x E F(a)}, 

F°P*(7r) := {x E F{a) : {c,x) = //(vr)}, 

F^-°pt(7r) := {x E F{a) : {c,x) < u{7i) + e}. 

For completeness, define i/(7r) = -|-cxd if F{a) = 0. 

Lastly, LSIO problems of the form ([^ satisfy the strong Slater condition with strong 
Slater constant p, if there exists xq G M" and p > 0 such that {at, xq) > bt + p for all t E T. 

^We will write ‘e-optimal solution set’ going forward. 
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2.2.2 Distance Metrics 


Let II ■ II denote the Euclidean norm in the context-appropriate dimension. Let two constraint 
systems cxi and ct2 be given. For a fixed t, let (a},bj:) G and e be the 

t-th constraint of cti and (T 2 , respectively. Let d{{al, bj), (af, b^)) denote the distance between 
these constraints: 





Let S^{ai,a 2 ) denote the distance between constraint systems ai and a 2 '- 


(5^(cti, (T 2 ) := sup d{{al, b]), (a^, b'f)). 

t£T 


Also, let 5'^(7ri,7r2) denote the distance between problems tti := (c^,cri) and 7r2 := (c^,(J 2 ): 

<5"(7ri,vr2) := max{||c^ - c^||, (5^(ai, 0 - 2 )}. 


2.2.3 Equivalence relations 

We define equivalence relations between problems based on their constraint systems and their 
cost function. Let ai <^2 (“S-equivalence”) denote an equivalence between the constraint 
systems of problems tti = (c^cti) = (c^, (a^,6^)) and 7r2 = (c^,cr 2 ) = (c^, (a^,6^)) when 

{K‘,6,'), ( 6 T} = {(«?,()?),« 6 T}. 

Under this equivalence, problems tti and 7^2 are equivalent up to an ordering of the indices 
and redundancy in the constraints, which is a stronger condition than the feasible solution 
sets being the sam^ -^(<^ 1 ) = Let tti ~n 7r2 (“Ll-equivalence”) denote an equivalence 

between tti and 7r2 when in addition to ui (^ 2 - Note that Ll-equivalence implies 

that TTi and 112 share the same optimal value, feasible solution set, optimal solution set, and 
e-optimal solution set. In this paper, we will distinguish between “IT-equivalent” defined 
above and “equivalent”, which we use to refer to optimization problems that have the same 
feasible solution set, optimal value, optimal solution set, and e-optimal solution set. 

2.2.4 Why indexing matters in LSIO problems 

The following example illustrates an important subtlety when using the definitions in the 
previous two subsections. In particular, the choice of indexing in LSIO problems affects the 
5^ distance between them. 


^Suppose that tti 712 and that the constraint ( 0 ,a;) > —1 does not exist in either tti or 712. If we add 
the constraint ( 0 ,x) > —1 to tti, then it is no longer the case that tti 712. However, because ( 0 ,a;) > —1 
is a trivial constraint, we still have F{ai) = F{a2)- 
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Example 2.1 (LSIO distances) Consider the following Ti-equivalent constraint systems 
(Ti = (a^, C) and a 2 = {of, with T = {1, 2}, and of := (a^, al) and of := {of, a^): 


o^ — o^ — 


(Xo - dry - 


b] = 62 = 0 Vt G T. 

Then S^{a^,a‘^) = 0. On the other hand, if we simply swap the indexing of two of the a 
vectors 


o^ — o^ — 


do — di — 


h\ = hl = 0 VtGT, 

then = \/2. Simply rearranging the indices generates a different 6^ distance, even 

though these constraint systems are T-equivalent. □ 


2.2.5 Classifying LSIO problems 

Let Sj := {(j G S : F{a) 7 ^ 0} denote the set of feasible constraint systems and Sj := E\Sj 
denote the set of infeasible constraint systems. Let IIj := {vr G 11 : a G S/} denote the set 
of feasible problems and 11* := n\nj denote the set of infeasible problems. Furthermore, 
let IIs := {tt G n : F°P*( 7 r) 7 ^ 0 } denote the set of solvable problems. Finally, we dehne 
^oo := {cr G S : bd(Sj)) = +cxd} and IIoo := {tt G LI : 5 ^( 7 r, bd(nj)) = +cxd}. Useful 

facts about these sets of LSIO problems are stated and proved in Appendix [X} 


2.3 Robust Optimization 


In this section, we present a formulation of the Robust Linear Optimization problem. We 
begin with a RO problem with a single constraint and then generalize to the case of multiple 
constraints. Although our results hold for the general case, we present results for the single¬ 
constraint case first in Sections and to help build intuition. 

Suppose c is the cost function, a is the coefficient vector, and b is the right-hand side 
value. For now, suppose c and b are hxed, but a is uncertain and lies in an uncertainty set 
U C M"’, which is a non-empty, compact, and convex subset of MT. Then the single-constraint 
RO problem is: 


inf 

a;eK" 


subject to 


(c, x) 

(a, x) > b, Va G U. 


( 2 ) 


We denote RO(U) := (c, U, b) as the tuple that uniquely determines the single-constraint 
RO problem ([^. To avoid defining new notation, we denote its feasible solution set, optimal 
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value, optimal solution set, and e-optimal solution set of RO problems in the same way as in 
the LSIO case: F(RO(t/)), i/(RO(t/)), F°P*(RO(t/)), and F^-°p*(RO(R)), respectively; the 
context will make it clear whether we are talking about LSIO or RO problem^ 

We measure the distance between two uncertainty sets U and V using the Hausdorff 
distance: 


R) := max < sup inf Hn — n||, sup inf ||m —n| 

v£V vGV uGU 

Now we generalize formulation ([^ to the multiple-constraint case, as well as the case of 
uncertainty in both the cost function and right-hand side values. Suppose c is an uncertain 
cost function and lies in an uncertainty set C C M”'. Suppose I is an index set that is 
possibly uncountable. For each a E I, suppose (a“,6") is an uncertain constraint that 
lies in an uncertainty set Ua ^ Each constraint, then, has an uncertainty set that 

is independent of the uncertainty sets in the other constraints. For convenience, write the 
constraint-wise uncertainty set l:i(U) := Then, the multiple-constraint RO problem 


is: 


inf sup 

xsM"ceC 


(c, x). 


subject to (a",x) > b°‘, (a“,6“) G Ua, Va G /. 


( 3 ) 


Without loss of generality, we prove our stability results for constraint-wise uncertainty 
sets of the form tl(U). This is because, for any RO problem with an arbitrary uncertainty 
set U on the constraints, it is possible to formulate an RO problem of the form (|^ with an 
uncertainty set of the form tl(U) := <S>aei^o‘ generated from U (provided U generates Ua 


that are compact and convex). See Remark 5.4 for additional details 


( 4 ) 


As in the LSIO case, a RO problem satishes the strong Slater condition with strong Slater 
constant p, if there exists xq G M” and p > 0 such that (a", xq) > 6“ -|- p for all (a“, b°‘) G Ua, 
a E I. We can assume the uncertainty is only in the constraints, characterized completely 
by t](U), with hxed cost function c: 

inf {c,x), 
xeK" 

subject to {cU,x) > b°‘, (a“,6“) G Ua, Va G I, 

which is transformed from the formulation through an epigraph reformulation. Note that 
if ([^ satishes the strong Slater condition, does as well, with the same Slater constant. 

We denote RO(tl(U)) := (t](U)) as the (singleton) tuple that uniquely determines the 
multiple-constraint RO problem. When I is uncountably inhnite, formulation (|^ is actually 
a robust LSIO problem. Thus, beyond simply generalizing the single-constraint problem, 
the results we derive for robust linear optimization using formulation (Q extend to robust 
LSIO problems by dehnition (Goberna and Lopez 2014| ), and give insight into the stability 
of robust convex optimization. 

The quantities F(RO(^(U))), i/(RO(^(U))), F°p*(RO(^(U))), and F^-°p*(RO(^(U))) are 
dehned analogously to the single-constraint case. Given two constraint-wise uncertainty sets 
t](U) and tl(V), we dehne a distance metric d(,(tl(U), tl(V)) as: 

d^(^(U),^(V)) -.= sup dH{Ua,Va), 

a£l 


^Note that we write F(RO(t 7 )) as the feasible solution set of a robust problem, without making a dis¬ 
tinction between a “constraint system” {U, b) and a RO “problem” (c, U, b). 
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defined on the metric space of constraint-wise uncertainty sets where the uncertainty set on 
each constraint is compact and convex. 

Table [T] in Appendix summarizes the notation used in this paper. 


2.4 Important Theorems 

The main results we present in this paper parallel and leverage the following established 
results on stability of LSIO and general convex optimization problems. 


2.4.1 Lipschitz continuity of the optimal value 

Theorem 2.2 (Theorem 4.3 from Canovas et al. |2006b| ) LetTiQ = (c°, (To) G int(ns), 
and let 0 < e < (5^(7ro, bd(n 5 )). Ifni = {c^,cri) and n^ = (c^, CT 2 ) problems in fl satisfying 
6^{nj,no) < e for j = 1,2, then 


where 


|i/(7ri) - i/(7r2)| < T(7ro,e)5^(7ri,7r2), 

0 V’(h(7ro,e)) 


L(7ro,e) := (p*(0) (e ||c 


(5^(cro,Si) 


+ /i(7ro,e) , 


( 5 ) 

( 6 ) 


with functions (p*(-) and '?/’(•), and constant p(-,e) as defined in Definition f.2 


The above theorem establishes Lipschitz continuity of the optimal value for LSIO prob¬ 
lems: the difference in the optimal value between two sufficiently close LSIO problems is 
bounded linearly by their distance in the 5^-metric. Note that this is a local Lipschitz 
continuity result because the problems under consideration, tti and 7r2, must reside in a 
neighborhood of a third problem, ttq. 


2.4.2 Closedness and Upper Semi-Continuity of optimal solution set 

Note that F(-) can be dehned as a set mapping from the set of constraint systems S to the 
set of subsets of Similarly, z/(-), F°p*(-), and can be viewed as set mappings 

from the set of problems 11 to the set of (extended) real numbers, in the case of the optimal 
value, and the set of subsets of in the case of the optimal and e-optimal solution set. 


Theorem 2.3 (Theorem 3.1 (i),(ii), and (vi) from Goberna et al. |1996| ) Ifn := (c, c 

11/, then the following are equivalent: 

1. F{-) is lower semi-continuous at a. 

2. n E int(n/). 


3. n satisfies the strong Slater condition. 


Theorem 2.4 (Theorem 5.1 (i) and (ii) from Canovas et al. 1999] ) Ifn := (c,a) G 
Ils, then: 
























1. F°P*(-) is closed at tt if and only if either F{-) is lower semi-continuous at vr or F{a) = 
F°P*(7r). 

2. //F°P*(-) is upper semi-continuous at n, then is closed at tt. The converse is 

true if F°^^{'n') is hounded. 


These two theorems are largely technical theorems that relate the different notions of 
qualitative stability in LSIO problems, including closedness, lower semi-continuity, and upper 
semi-continuity. As stated in Lopez 2012| , closedness means that every convergent sequence 
composed of points from the sequence of solution sets always converges to a point in the limit 
set. Lower (upper) semi-continuity guarantees that the solution sets do not shrink (explode) 
in size in the limit. 


2.4.3 Lipschitz continuity of the e-optimal solution set 

Theorem 2.5 (Theorem 7.69 from Rockafellar and Wets |2009| ) Let f and g be proper, 
lower semi-continuous, convex functions on M"' with argmin/ and argmingf non-empty. Let 
Vq be large enough that argmin/ fl r^B ^ 0 and argmingf fl r^B ^ 0, and also min / > —rg 
and min^f > —rg. Then, with r > rg, e > 0 and rj = dr{f,g), 


_ 2r 

d,.(e-argmin/, e-argmingf) < r/ ( 1 -|- =-^ 


^ < (1 + 4re ^)6 f{f,g), 


(7) 


where d^ is defined in Def. 7 .1 and Sf is defined in Def. 


7.2 


This theorem establishes Lipschitz continuity of the e-optimal set of minimizers for 
proper, lower semi-continuous, convex functions. In turn, this result applies to LSIO prob¬ 
lems because, as we shall see in Section a LSIO problem can be equivalently represented 
as the minimization of a proper, lower semi-continuous, convex function. 


3 RO-LSIO Transformation 

It is well-known that RO problems can be considered as LSIO problems. However, LSIO 
problems are defined with respect to some index set T, while RO problems are defined 
without reference to any index set. In addition, for a given RO problem and for any choice 
of T of appropriate cardinality, there are an infinite number of H-equivalent LSIO problems 
defined with respect to T that are equivalent to the RO problem. Thus, the challenge when 
comparing different RO problems (for the purpose of evaluating stability or continuity with 
respect to perturbations in the uncertainty set) is twofold. First, we must define a common 
index set T so that for any two given RO problems, the LSIO problems generated with 
respect to T that are respectively equivalent to the RO problems have a well-defined 5*^- 
distance. Second, using this T, we must define a RO-LSIO transformation that is a local 
isometry between the space of RO problems and the space of LSIO problems. That is, RO 
problems whose uncertainty sets are close in Hausdorff distance are mapped into respectively 
equivalent LSIO problems that are close in the 5^-metric. The following conceptual example 
illustrates these challenges. 
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(a) Indexing yielding LSIO prob- (b) Indexing yielding LSIO prob¬ 
lems with small (5^-distance. lems with large (5'^-distance. 

Figure 1: Different indexing for RO problems. 


Example 3.1 (Indexing issues in the RO-LSIO transformation) Consider Figuresfl^ 
and lb, depicting two polyhedral uncertainty sets, U and V, from two RO problems. Since 


the uncertainty sets are the same in the two figures, d}j(U, V) is the same in both. 

Now consider the LSIO problems induced by the indexing of the vertices of U and V as 
shown, which amounts to listing out the constraints in the form of a LSIO problem Q. For 
polyhedral uncertainty sets, it suffices to index the vertices to transform an RO problem into 
a LSIO problem. First, note that defining T = {1,... ,5} would be sufficient to label all the 
vertices of V, but insufficient to label all the vertices of U, so a more appropriate index set 
isT = 6}. 

Second, note the different LSIO problems generated by different ways of indexing the 
vertices in Figures la and lb In Figure\lc^ the distance t^v) between the two generated 

LSIO problems ttu and Tty is characterized by the distance between vertex 5 in U and vertex 
5 in V. However, if we change the indexing of the vertices ofV, as shown in Figure [7^ the 
distance 5^{nu,T{'y) between the two generated LSIO problems ttu and Hy is characterized by 
the distance between vertex 3 inU and vertex 3 in V. Clearly TTy) > vry), even 

though TTy ~n Tty. So even in the case where |T| is finite, the choice of T and the specific 
RO-LSIO indexing affects the measurement of distance using the 5*^ metric. 


3.1 Transformation theorem: single-constraint case 

To be able to index all elements from general uncertainty sets U and V, which are uncountable 
subsets of we choose the index set T to be MR itself. The explicit RO-LSIO transfor¬ 
mation for RO(f/) and RO(R) that we desire will yield LSIO problems whose distance in 
the h^-metric is precisely equal to dniU, V). To help create such a transformation, note that 
repeating a constraint or adding a trivial constraint (e.g., (0„,x) > —p, where p > 0) can 
alter the distance between Il-equivalent LSIOs, but does not change the feasible solution set. 

Theorem 3.2 (RO-LSIO transformation for single-constraint RO problems) Let p > 

0 be given. Let RO(f/) and RO(R) be RO problems of the form (|^ with non-empty compact 
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and convex uncertainty sets ?7 C M" and V C M”, cost function c, and right-hand side value 
b. Define T := M” as the common index set, with elements denoted by t. Define the LSIO 
problems 7iu-,v '■= {c,au-,v) o^nd ttv-u '■= {c,av-u) as follows: 


1 

\ it, b) 

ifteU, 

(^uy{t) ■— \ 

(argmin„g^||M-t||,6) 

ifteV\U, 

\ 

[ (On, -p) 

ift ^UUV, 


(it, h) 

if t eV, 

■= < 

(argmin^gylln -t\\,b) 

tfteu\v, 


[(On,-p) 

ift ^UUV. 

Then iiuy 7iv,u well-defined and are equivalent 

Lastly, S^{7iuy,nv-u) = dniU,]/). 

to RO(17) and RO(E), respectively. 

Remark 3.3 Here, we write argmin to refer to the unique element, rather than the (single¬ 
ton) set, that minimizes the function in question. This abuse of notation for argmin is used 

in the later theorems as well. 




Proof: We first prove that vTf/^y is a well-defined LSIO problem and is eqnivalent to RO(17). 
We omit the analogous proof for ny-u and RO(ld). Finally, we prove that S^{7iu;V,'^v-,u) = 
dH{U,V). 

To show that t^'u-v is well-dehned, we must show that o'u-v maps every element in T := M” 
to exactly one constraint (i.e., vector in When t G 17 or t ^ t/ U Id, it is clear that 

t maps to exactly one constraint, either {t,b) or (0„, —p), respectively. When t G V\U, the 
existence and uniqueness of argmin^g[;||M — f|| follows from U being compact and convex, and 
II ■ II being the Euclidean norm. 

To show that nu-y is equivalent to RO(17), it suffices to show that 7iu-,v has exactly the same 
feasible solution set and cost function as RO(17). First, if t G f/, then au-yit) := (t, 6), so 
every constraint in RO(17) is listed in nuy. Second, since argmin^g[;||M —1|| G t/, if t G V\U, 
then au-vif) := (argmin^g^Hu — t\\,b) is a redundant constraint. Lastly, if t ^ U UV, then 
o'u;v{t) '■= (On, —p), which is a trivial constraint. Thus, every constraint in RO(17) is included 
in nu-y and all the other constraints of t^'u-v do not constrain the feasible solution set any 
further. Thus, the feasible solution set of T^'uy is the same as RO(17), and since the cost 
function is the same by construction, it follows that the optimal value and optimal solution 
set of 7iuy and RO(f/) are also the same. 

Lastly, we show that 5^{nuy, t^v-,u) = dufU, V). Observe that for every t 


G T; 


(0 


lo'uyi't) — o-yyit)]] = < 


\u 


t\\ 

■t\\ 


( 8 ) 


mm„6y 
min„g[7 
,0 

where the minimum in the case t G U\V follows because ||f—argmin^gy||n—f|| || = min„gy Un¬ 
til, and analogously for the case t G V\U. Taking the supremum of ([^ over t eT: 


if t G t/ n E, 
if t G U\V, 
if t G V\U, 
if t^UUV, 


sup 

ter 


\(^uy{i) — (^V;U 


= max < sup 0, sup min 

teunv t&u\v v&v 


|n —t||, sup min 
t&v\u ueu 


|m —t||, sup 0 
t^uuv 


(9) 
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Figure 2: Defining TTu-y^ indexing T. The 3 scenarios of when t & U, t ^ V\U and t ^ UUV 


By dehnition, sup^gj. \\au.y{t) — av-u{t)\\ = 6^{au.y, ayy)- Since the cost function is the same 
for both TTuy and nyy, it follows that sup^g^- \ Wu-yit) ~(^v-,uit)\\ = crvy)- Note that 

supig[/\y min^gy ||n — t\\ = sup^g^/min^gy ||n — f|| because if t eV, then min„gy ||n — f|| = 0. 
Analogously, sup^gy^^ min^gf/ ||m — t\\ = sup^gy min„g{/ ||m — f||. Finally, replacing the ‘min’ 
with ‘inf’ in (|^; 

S^{T^uy,T^v-,u) = sup \\auy{t) — av-uit)\\ = 

teT 

max < sup inf ||n — f||, sup inf \\u — t|| [■ = dniU, V). 
[teu v£V tev ueu J 

□ 


Figure]^ gives a picture of Theorem 3.2 and how we dehne TTuy and, analogously, TTyy. 


3.2 Transformation theorem - multiple-constraints case 

To generalize Theorem |3. 2 we consider the case of robust problems with multiple constraints 
under uncertainty. We consider a special case of uncertainty for multiple constraints, as stated 
in the Introduction, namely, problems with hxed cost function and uncertainty sets tl(U) and 
1:](V) for the constraints. Here, tl(U) and tl(V) are the Cartesian products of compact and 
convex 17^ and W which are subsets of M”, where a E I for some constraint index set I. In 
this case, the set T must be chosen as the set I x M” x M, with elements t := {a,t,s) with 
t eW^ and s G M. 


Theorem 3.4 (RO-LSIO transformation for multiple-constraint problems) Let p > 

0 he given. Let RO(tl(U)) and RO(t](V)) he RO problems with uncertainty sets t](U) and 
1:](V) with compact and convex Lf^ ^ o,nd ^ for all a E I for some arbitrary index 
set I. Define T := I x M"’ x M as the common index set, with elements denoted by t E T 
which are tuples t := {a,t,s) where a E I, t E M”, and s G M. Define the LSIO problems 
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7ri,(u);^{v) := (c, ai,(u);^(v)) and ■= (c, cTt,(v);[](u)) as follows: 



' it, s) 

if{t,s) G Ua, 

o'ti(u);^(v)(t) - a(,(u),^(v)((a,^,-s)) < 

argmin(„^ „^)gf;^d((na, Ub), {t, s)) 

tf{t,s)eVa\Ua, 


,(0n,-p) 

if {t, .s) ^UaU Va: 


' {t,s) 

if {t,s) G Va, 

0'tl(V);[l(U)(t) = 0'll(V);[l(U)((tt,^,'S)) ;= < 

argmin(„^ „^)gy^d((na,'yb), (t,s)) 

zf(t,s)eUa\Va, 


1 

o 

if {t, s) ^UaU Va, 


where d{-, •) refers to the Euclidean metric. Then 7rt,(u);t|(v) and 7r[,(v);ii(u) well-defined and 
are equivalent to RO(tl(U)) and RO(tl(V)), respectively. Lastly, 5'^(7r[,(u)-^{v),7J'i](v)-^{u)) = 

d^(^(U),^(V)):=sup,,,ciH(^.,K). 


Proof: We first prove that 7rt,(u);t](v) is a well-defined LSIO problem and is equivalent to 
RO(t](U)). We omit the analogous proof for 7rt,(v);^(u) and RO(t](V)). Then, we prove that 
<^’^(7ri,(u);i:(v), 7ri,(v);i](u)) = d^(t](U), t](V)). 

To show that 7r[,(u);i](v) is well-dehned, we must show that (Tt,(u),t](v) maps every element in 
T to exactly one constraint (i.e., vector in For any given a, when {t,s) G Ua or 

(t, s) ^ [/q, U Va, it is clear that (f, s) maps to exactly one constraint, either (f, s) or (0^, —p). 
When (t, s) G Va\Ua, the existence and uniqueness of argmin(-„^^^^)gf/^(i((Ma, Ub), {t, s)) follows 
from Ua being compact and convex, and d{-,-) being the Euclidean norm. 

To show that 7r(,(u);^(v) is equivalent to RO(tl(U)), it suffices to show that 7rt,(u);t|(v) has exactly 
the same feasible solution set and cost function as RO(tl(U)). Let a G / be chosen. First, if 
(t, s) G Ua, then o'[,(u);i](v)(('a, t, -s)) := {t, s), thus, since we chose arbitrary a, every constraint 
in RO(t](U)) is listed in 7rt,(u);i](v)- Second, since argmin^^^ «&), (t, s)) G Ua, if 

(t,s) G Va\Ua, then (T(,(u);i,(v)((tt, t, s)) := argmin(„^ Wfe), (t, s)) is a redundant 

constraint. Lastly, if (t,s) ^ UaU Va, then (T[,(u);^(v)((tt, -s)) := (On, —p), which is a trivial 
constraint. Thus, every constraint in RO(t](U)) is included in 7rt|(u);[](v) and all the other 
constraints of 7r(,(u);^(v) do not constrain the feasible solution set any further. Thus, the 
feasible solution set of 7r(,(u);^(v) is the same as RO(tl(U)), and since the cost function is the 
same by construction, it follows that the optimal value and optimal solution set of 7r(,(u);^(v) 
and RO(tl(U)) are also the same. 

Lastly, we show that 7r[,(v);[i(u)) = di^(tl(U), tl(V)). Observe that for every 

(a,t,s) G T; 


|o'^(U);[l(V)((a, t, s))-(Tl,(v);l,(U)((tt, t, s))|| - 


r 0 if (t, s) e Ua Li Va 

d{{va, Vb), {t, s)) if {t, s) G 


min(n^,n^)g[/^ d{{Ua, Ub), {t, s)) if {t, s) G Va\Ua 
0 if (t, s) ^UaU Va, 


( 10 ) 


where the minimum in the case t G Ua\Va follows because d{{t, s), argmin(-„^^^^)gy^(i((na, Vb), {t, s))) = 
min(^^^„j^)gy^ d{{Va,Vb), (t,s)), by dehnition, and analogously for the case t G Va\Ua. Taking 
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the supremum of ( [l0| ) over t = (a, t, s) G T: 
sup ||(T[,(u);[,(v)((a,^, s)) - cTi,(v);t,(u)((a,^,s))|| = 

teT 


sup 0, sup min d{{va,Vb), {t, s)), sup min d{{ua,Ub), {t, s)), sup 0>. 


sup 

ael I {t,s)£UanVa (t,s)£Ua\Va {Va,Vb)&Va 


{t,s)eVa\Ua {Ua,Ub)&Ua 


(t,s)0JaVJVa 


By definition, sup^g^. ||crc/;V'(t) — cry;t/(t)|| = 5^(crt,(u);t](v)5 crt](v);i](u))- Since the cost function 
is the same for both 7ri,(u);ii(v) and vr(,(v);^{u); h follows that sup^g^^ ||crf/;y(t) — av-u{'^)\\ = 
^"(7rt,(U);ll(V),7rt,(V);l,(U))- 

Note that sup min d{{va,Vb), (t, s)) = sup min d{{va,Vb), (t, s)) because if 
{t,s)£Ua\Va iVa,Vb)£Va it,s)£Ua {Va,Vb)&Va 

(t, s) e Va, then min(^„,^j)6y^ d((va, Vb), (t, s)) = 0. 

Analogously, sup min d{{ua,Ub), (t, s)) = sup min d{{ua,Ub), (t, s)). Finally, 
(t,s)eVa\Ua iUa,Ub)&Ua _ (t,s)&Va iUa,Ub)eUa 

replacing the ‘min’ with ‘inf’ in (11): 

^"(7r[,(U);^(V),7r[,(v);[,(U)) = sup ||(Tl,(u);^(V)(t) - Cril(V);ll(U)(t)|| = 

teT 


( 11 ) 


sup < sup inf d{{Va,Vb), {t, s)), sup inf (i((Ua, (t, s)) > = sup dniU^V). 


ael I {t,s)£Ua (Va,Vb)eVa 


{t,s)eVa {Ua,Ub)&Ua 


a&I 


□ 


4 Lipschitz constant invariance 


We hrst dehne several set mappings and present two technical lemmas that we will use in 
our proof of Lipschitz constant invariance. 


Definition 4.1 (Set mapping definitions from [C4novas 

lowing set mappings for vr := (c, a) = (c, (at, bt)t£T)-' 


et al. |2006b| ) Define the fol- 


A(a) 

R{7r) 

Z-(7r) 

H{a) 


conv({ai,f e T}), 
{-bt,te T;iy{7r)}, 
conv({ai, t E T; —c}). 




+ 


-h 




> 0 


Definition 4.2 (Constants from Canovas et al. |2006b| ) ForanyiTo := (c°,cto) G int(ns), 
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define the following quantities for 0 < e < 5'^(7ro,bd(ns)).' 


V7(A) = V7*(A) 

:= yiTP, 

'tp{a) 

:= (1 + q;)\/1 + 

p(7ro) 

sup Rijo) 

d*(0„,bd(Z-(7ro)))’ 

/^Ka) 

• 5^(ao,E,)-e’ 

7(7ro,e) 

:= (p*(0)(p(7ro) + e/3(7ro,e)) + ||c°||*/?(7ro, e), 

p(7ro,e) 

supi?(7ro) + emax{l,7(7ro,e)} 

•“ ^ d(0„,bd(Z-(7ro)))-6 ’ 

L(7ro,e) 



Lemma 4.3 (Distance to ill-posedness) If tt := (c, uo) G Hf, then 

S^{ao,E,) = 


Proof: In Appendix |B.1[ 


□ 


Lemma 4.4 (Constants in Definition 

int(ns), we have: 

1. d{On+i,hd{H{ao))) > 0, 

2 . d(On,bd(2'“(7ro))) > 0, 

3. 5n(7ro,bd(n,)) >0, 

4- Let any 0 < e < (5'^(7ro, bd(ns)) be given, then (5^(cro, E*) > e. 

In particular, all the values in Definition\4.^ are well-defined for 0 < e < 5’^(7ro, bd(ns)). 


4.2 are well-defined) For any tto := (c°,(Jo) G 


Proof: In Appendix B.2 


Now we proceed to prove that given any two LSIO problems tti, 7r2 G int(ns 
TTi ~n 7r2, then, the Lipschitz constants in Theorem 2.2 satisfy L(7ri, e)=L(7r2, e). 


□ 

such that 


Lemma 4.5 (Lipschitz constant invariance) Let tii = (c^,cri) G int(ns) and 7^2 = (c^,(j 2 ) G 
int(n 5 ). Suppose tti ~n 7r2. Then: 

1 . 5n(7ri,bd(n,)) = 5n(7r2,bd(n,)). 

2 . 5^((Ti,Si) = 5 ^{a2,Tii) and furthermore, if 0 < e < 5^(7ri, bd(ns)) = 5'^(7r2, bd(ns)), 
then L{7ii,e) = L(vr 2 , e). 


Proof: 


15 















1. By the definition of tti ~n we have ci = C 2 , and cxi := 


<72 


{af,b‘f)t£T, that is, {{aj,bl),t G T} = {{af,b‘f),t G T}. By the definition of H{-), it is 
clear that if (di) = if (CT 2 ), which implies that (i(0n+i, bd(i/(cTi))) = (i(0n+i, bd(-ff((T 2 ))). 
Similarly, Z“(7ri) = Z“(7r2), which implies that (i( 0 „, bd(Z“(7ri))) = d{ 0 n,hd{Z~{712)))- 


Since both tti and 7r2 G int(n5) C 01(115), we can apply Theorem 2 from Canovas et ah 
2006a . This theorem states that, for tt := (c, a) G cl(n5). 


5"(7r,bd(n5)) = min {ci(0n+i,bd(if(a))),d(0„,bd(Z (vr)))}, 
which implies that (5'^(7ri, bd(n 5 )) = 5'^(7r2, bd(n 5 )). 

2. As shown in the proof of part 1 of this Lemma, (i(0„+i, bd(iL((Ji))) = (i(0„+i, bd(if(cr 2 ))). 


so by Lemma 4.3, 5^(cri,Sj) = 5^((j2,Sj). Finally, L(7ri,e) = L(7r2,e) for Ll-equivalent 


problems 7ri,7r2 follows directly from the definition of L(-,e) and all the supporting 
quantities in Definitions 4T and |4.2[ □ 


5 Lipschitz continuity of the optimal value 

We now state and prove Lipschitz continuity for the optimal value in both the single¬ 
constraint and multiple-constraint case. 


5.1 Single-constraint 

Theorem 5.1 (Lipschitz continuity for single-constraint RO) LetIlO{U) be a RO prob¬ 
lem of the form ([^ with non-empty compact and convex uncertainty set U C M"-, fixed cost 
function c, and right-hand side value b. Suppose that: 

1. RO(t/) satisfies the strong Slater condition, with strong Slater constant p > 0, 

2. F°P*(RO(f/)) is non-empty and hounded. 

Then, there exists a LSIO nu ■= (c,cru) G int(n 5 ), where: 

^ 

■ \{0n,-p) tft^U, 

such that for any e satisfying 0 < e < (5'^(7r;7, bd(n 5 )), and for all compact, convex uncertainty 
sets 1/ C M"- satisfying dufU, V) < e. 


n(RO(17)) - n(RO(l/))| < L{U,e)dH{U,V). 


The Lipschitz constant L(U, e) 
(c, au) and the given e. 


L{Tijj,e) can he calculated via Definition f.2 using ttu ■= 


Proof: The proof proceeds in seven steps. Figure gives a conceptual illustration of the 
proof idea. Let T := M". 
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1. Write RO(t/) as the LSIO problem ttu. First, we show that ttu and RO(?7) are equiv¬ 
alent. Note that the cost functions for the two problems are the same, and that ttu 
contains all the constraints of WO{U) plus some additional trivial constraints. Thus 
Tiu and RO(17) have the same feasible solution set, optimal value, and optimal solution 
sets. Furthermore, since RO(17) satisfies the strong Slater condition with Slater con¬ 
stant p, and since (0„, x) > —p -|- p = 0 for all x, it follows that tiu satisfies the strong 
Slater condition with Slater constant p. 


Second, we show that tiu G int(ns). By assumption, F°p*(RO([/)) is non-empty and 
bounded, so F°^^(pKu) is non-empty and bounded. Since ttu satishes the strong Slater 
condition, by Theorem 2.3 we have ttu G int(nj). 

anovas et ah |2006^ , c G int(cone({ai : t G 
proposition, implies that ttu G int(ns). 


By Proposition 1 part (vi) from 
T})), which, by part (vii) of the same 


2. Choose V in an e-neighborhood ofU. Let e > 0 be given satisfying 0 < e < bd(ns)). 

Such an e exists because (5'^(7r[/, bd(n 5 )) > 0 by Lemma 4.4 Let V be any compact 
and convex set in M” satisfying dniUjV) < e < 5^(7rt/,bd(ns)). Such a V exists; e.g., 
the choice V := U -\- B{0, e/2) satishes dniJJ, V) < e. 


3. Define ttu-v '■= (c, o’u-y). Dehne the LSIO problem vr^/.y := (c, auy) as in Theorem 3.2 


By the same theorem, iruy is well-dehned. Since for each t G V\U, argmin„g[;||M — f|| 
is an element of [/, every constraint in nuy is in tiu and vice versa. Thus, iTu-y ~n t^u- 
Furthermore, since -Kuy ~n t^u and ttu satishes the strong Slater condition with Slater 
constant p, it follows that Tiuy also satishes the strong Slater condition with constant 

p > 0. 


4. Define ny-u ■= (c, o'vy)- Dehne the LSIO problem nvy := (c, ay-u) as in Theorem 3.2 
By the same theorem, iryy is well-dehned and is equivalent to RO(Id). 


5. By Theorem 3.2. S^{7ru.y,7ry.y) = duiJJ.V) < e. 


6. Apply Theorem 2.2 with ttu-v ^ tto, tti and ivy-y i—>• ti 2 . We check that the assumptions 
of Theorem 12.21 are satished: 


(a) 'Xuy £ int(ns). This proof is identical to the proof that ttu G int(ns), given in 
Step 1. 

(b) e < (5'^(7r[/;y,bd(ns)). Recall that vTf/^y and tt;/ are both in int(ns), have non-empty 
bounded optimal solution sets, and are Il-equivalent to each other. Thus, we have 
e < 5’^(7rf/, bd(ns)) = 5'^(7r[/.y, bd(ns)), where the inequality is by assumption 
and the equality is by Lemma |T5 

(c) d^{T^uy)T^V\u) < ^ 0 ,'i^d d^iyiu-y^nuy) = 0 < e. The hrst inequality comes from 
Step 5, and the second inequality is trivial. 


Thus, the assumptions of Theorem 2.2 


are satished, so: 

^{.T^uy) — < L(^.y,e)5^{Tiuy,T^v-,u)^ 


where Ltyiuy, e) is as dehned in Dehnition 4.2 


( 12 ) 
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Figure 3: Proof idea; the picture here also illustrates cost function uncertainty, as will be 
discussed in the next sub-section. The thicker red and blue lines in Il-space represent LSIO 
problems that are Il-equivalent. Note that all the problems that are fl-equivalent to ttu have 
the same distance from bd(ns) 


7. Lastly, show that the Lipschitz constant is independent of the choice of V. Apply¬ 
ing Lemma 4.5 to Il-equivalent problems nu and vr^/.y, it follows that L{nu,e) = 
L{nu.y,e). Now define L{U,e) := L{nu,e). By recognizing that vinuy) = i^(RO(f/)) 
and iz^Tiv-u) = i^(RO(14)), and using S^{7iu.y,7iv-u) = duiU^V), we obtain the final 
result: 

|z/(RO(t/)) — z/(RO(l/))| = \i'{'Ku-,v) — (By definition of nu-y and 'nvy) 


< L{'Kuy, e)5^{'Kuy., T^vy), 
= L{Tiuy, e)dH{U, V), 

= L{U,e)dHiU,V). 


(By Theorem 
(By Theorem 
(Since Tiuy ~n t^u) 



□ 


5.2 Multiple-constraint 

Theorem 5.2 (Lipschitz continuity for multiple-constraint RO) Let RO(tl(U)) be a 
RO problem of the form (|^ with non-empty compact and convex uncertainty set Ua in each 
constraint, indexed by a E I, with fixed cost function c. Suppose that: 

1. RO(tl(U)) satisfies the strong Slater condition, with strong Slater constant p > 0, 

2. F°P*(RO(tl(U))) is non-empty and bounded, 

3. sup{—G /} < -|-oo. 

Then, there exists a LSIO problem 7rt|(u) G int(n 5 ), where: 


o'[i(u)(t) - cr[,(u)((a,t, s)) 


it, s) if (f, s) G Ua, 
(On; p) if {t, s') ^ Ua, 
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such that for any e satisfying 0 < e < (5’^(7r[,(u), bd(ns)), and for all t](V) C x M) 

with compact and convex Va satisfying sup^^j dH{Ua,Va) < e, we have: 

|z/(RO(^(U))) - z/(RO(^(V)))| < mV), 6)d^(^(U), ^(V)). 

The Lipschitz constant L(t](U),e) := L(7r(,(u),e) can be calculated via Definition 
•= and the given e. 

Remark 5.3 The theorem can be proved without the assumption that sup{—G /} < 
+ 00 , but the resulting proof is much more complicated and does not yield additional insight. 


4.2 using 


Proof: 

The proof is nearly identical to that of Theorem 5.1[ The only differences are that T is 
defined as / x x M and Theorem |3.4| is used in place of Theorem 3^ where appropriate. 
The full proof is given in Appendix □ 


Remark 5.4 Note that Theorem \5 . 2\ can still be applied even if we are given an arbitrary un¬ 
certainty set U that is not of the form specified in ([^ . ITe can simply generate an uncertainty 
set t](U) from U as follows: 

Uq := {(a“,6") G .■ 3A G U such that (a", 6") is the a-th row of A}, 


and ^(U) := (g)„g^ Ua- We can define RO(U) as follows: 


inf {c,x), 

X 

subject to {a°‘,x) > b°‘, {a°',b°‘)aei G U. 


(13) 


It is not hard to show that RO(U) and RO(tl(U)) are eguivalent. Thus, by applying Theorem 


5.2, we can bound the optimal values of the RO problems that have uncertainty sets U and 


V (that have compact and convex Ua and Va) with the d'^-distance between their respectively 
generated t](U) and t](V). 


6 Closedness and upper semi-continuity of the optimal solution set 


First, we provide definitions of closedness, lower semi-continuity and upper semi-continuity, 
as defined in Lopez |2012|. Then, we state and prove the main result of this section. 


Definition 6.1 (Definitions from Lopez |2012| ) We define the following properties of 
set valued mappings. Suppose 1C is a set valued mapping from If to the power set of M”. 
Suppose KRjf) 7^ 0 for some given n. Then: 


1. 1C is closed atir if for any seguence C 11 and {xj}Jf^ C M" such thatxj G lC{TTj) 

for all j, with tij —)■ W and Xj —)■ x for some x G M", we have x G 1C(W). 

2. 1C is lower semi-continuous (Isc) atw if for every open set O C M"’ such that /C( 7 f)n (9 7 ^ 
0 , there exists a neighborhood M of If such that for all n & JC we have /C(7r) fl (P 7^ 0. 
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3. K is upper semi-continuous (use) at vr if for each open set OCR" such that C O, 
there exists a neighborhood M of If such that for all vr G TV, we have /C(7r) C O. 


Remark 6.2 The definitions in Definition 6^ can be extended to any set-valued mapping 
between a metric space and the set of subsets of a metric space. In particular, we can put the 
metric space of all uncertainty sets of the form t](U) with metric d[, in the place of the space 
of LSIO problems 11. 


Theorem 6.3 (Closedness and upper semi-continuity of Let RO(tl(U)) be a RO 

problem of the form Q with non-empty compact and convex Ua, indexed by a E I, and with 
fixed cost function c. Suppose that: 

1. RO(tl(U)) satisfies the strong Slater condition, with strong Slater constant p > 0, 

2. F°P*(RO(tl(U))) is non-empty and bounded, 

3. sup{—G /} < -|-oo. 

Then, with respect to the metric d[,(t](U), tl(V)), 

1. F°P*(RO(-)) is closed at tl(U), 

2. F°P*(RO(-)) is upper semi-continuous at tl(U). 


Proof: 


1. F°P*(RO(-)) is closed at l:i(U). 

Let T := / X M” X M with elements {a,t,s) where a E I, t E MT and s G M. Let a 


sequence C and a sequence C F°P*(RO(l:](V)j)) with 

[\(V)j tl(U) and with Xj -E x for some a: G M"' be given. By definition, F°p*(RO(-)) 
is closed at tl(U) if a: G F°P*(RO(t](U))). The idea of the proof is to show that Xj 
becomes arbitrarily close to F(RO(t](U))) as j -E oo. Then, since i/(RO(t](V)j)) —)■ 
z/(RO(tl(U))) as j —>■ cx) by Theorem 5.2, it must be the case that x E F°P*(RO(tl(U))). 


1. Define a LSIO 7rt|(u) G int(n 5 ) that is eguivalent to RO(t](U)). Let vr[,(u) := 


c, cri,(u)) be defined as in Theorem 5.2, Then from Theorem 5.2, vr(,(u) G int(ns). 


is equivalent to RO(tl(U)), and satisfies the strong Slater condition . 

2. Define a LSIO 7r[,(u);i](v)j that is li-eguivalent to 

For each l:i(V)j, label the contraint uncertainty set associated with a E I as Vj^a, 
and define 7rt,(u);i,(v), := (c, (T^(u);^(v)J, where: 

({t, s) if (t, s) E 

c^«u),^(v),((Q;,t,s)) := <j argmin(„^ ,,^)g^^d((M„,M6), (t,s)) if (t, s) G Vj^a\Ua 

[(On,-p) if (t, s) ^ f/a U V>- 

The proof that vr(,(u);[](v)j is well-defined, is Il-equivalent to and that vrt,(u);t](v)j £ 
int(ns) is given in the proof of Theorem 5.2 Furthermore, since vr(,(u);^(v) ~n 
and vr[,(u) satisfies the strong Slater condition with Slater constant p, it follows that 
^li(u);h(v) also satisfies the strong Slater condition with constant p > 0. 
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3. Define a LSIO 7r[,(v)^;ii(u) ^hat is equivalent to RO(tl(V)). 

Analogously, define 7ri,(v),;^(u) := (c, crt,(v),;i,{u)), where: 

f {t, s) if (t, s) E 

(^lj(v)j-MU)((a,t,s)) := < argniin(^^ Vb), (t, s)) if (t,s) E Ua\Vj^a 

[(On,-p) if (t, s) ^ Da U Vj^a- 

The proof that this is well-dehned and is equivalent to RO(tl(V)) is given in the 


4. 


proof of Theorem |5.2[ 

Show that d{xj,F{a^(^).^{y).)) < 
We hrst show that 


d(a;j,F(a^(u);^(v),)) < 


».,ui«vi,a) dt(ll(U).l|(V),) for all]. 


Xf 


(14) 


_ ^^(g't|(U);tl(V )^, Si) 

Corollary 4.1 from Canovas et ah |2006b| states that for any E T^f and E 

Fiao), 


d{zfiF{a))< 


-5^(a, do), 


<5^, S,) 

for all a E int(Sj). Thus, inequality (14) follows from the application of that 
corollary with d[,(v) ;^(u) ^ and d^(u);ti(v) t a. What remains is to check that 
the assumptions of the corollary are satished, namely that cr[,(v)j;t](u) ^ and 
c^^(u);h(v), e int(S/). By Step 3, Xj E F°P*(7r^(v)^.^(u)) ^ ^(7r^(vp;^(u)), which im¬ 
plies that vrt|(v) ;t](u) has a non-empty feasible solution set. Thus, d[,(v) ;^{u) ^ Sj. 
Since satishes the strong Slater condition, by Theorem 2.3, di,(u);i](v)j ^ 

int(S/). 

Then, we note that 

^^(crii(u);ii(v)p crti(v)j;[](u)) = di,(tl(U), tl(V)j) (15) 

by Theorem 3.4, since vr^(u);[i(v)j and vr[,(v)j;^(u) have the same cost function. 

Combining (14) and (15) yields the desired inequality: 

^(Ik.ll) 


d{xj,F{ai^(^u)■i^(y).)) < 




(16) 


<5^(o'll(U);l:(vp, Sj) 

5. Show that x E F((Ti,(u))- 

Since vrt,(u).[,(v)j. is equivalent to RO(tl(U)), it follows that F°P*(7rt|(u);t|(v)j) is non¬ 
empty and bounded, which implies that 7rt|(u);t](v) ^ int(ns) (cf. proof of Theo¬ 
rem 


5.2 ). Furthermore, since 7r[,(u);^(v)j ~n 7r[i(u) for all j, then F(crt,(u);t,(vp) = 
F((Tt|(u)) for all j and Lemma 4.5 further implies that 5^(crt,(u);[i(v)j, ^i) = <5^(n'ij(u)) ^i) 
Thus, for any j, (16) can be rewritten: 

V’(lkjll) 


d{xj,F{a^^u))) < 


<5^(n't,(u), Si 


-d^(^(U),^(V), 


(17) 


We use inequality (17) to show that d{xj, F{a\^(^[j))) —)■ 0 as j —)■ cxd. This re¬ 
sult follows because the sequence '0(||a;j||) is bounded (-0(11 ■ ||) is continuous and 
Xj —)■ X implies that ^dlxjH) —>■ ^dlxH)) and dt,(tl(U), t](V)j) —)■ 0 as j —)■ oo by 
assumption. 

Next consider a subsequence of labeled and indexed by jk- For 

each fc, since d{xj, F{a\^{\j))) —)■ 0 as j —)■ oo, we can choose jk large enough so 
that d{xj^^F{a^(\j))) < Now, we consider a different sequence C 
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-^(o'ti(u)) such that d{xj^,x'^) —)• 0 as A; —>■ oo, which implies —)■ x. The existence 

of the sequence follows from the fact that 

^ inf d(xj,,x') < 
a;'eF(o-i,(u)) 

and for each k, we can dehne a point x'^ in F((Jt|(u)) satisfying d{xj^,,x'jj < 2~^. 
Finally, we must show that x'^ —>■ x as A; —)■ cx). By the triangle inequality: 

d{x[,x) < d(Xfc,XjJ + d{xj^,x) 0 

as A: —>■ oo. Lastly, since F(cT[,(u)) is closed (it is the intersection of closed sets), 
and x'f, —)■ X, we have that x G F((T[,(u))- 


6. Show that x G F°P*(7rt|(u)) = -F°'’*(RO(tl(U))). 

Now we will show that x is indeed an optimal solution of 7rt|(u);^(v) and RO(tl(U)). 
Theorem 5.2 holds for RO(l:](U)), so that z/(RO(t](V)j)) —)■ z/(RO(tl(U))) as 
A: —)• oo. Also, Xj —)■ x, so that {c,Xj) —)■ (c, x). Thus, since Xj G F°P*(RO(tl(V)j)), 
we have that {c,Xj) = i/(RO(t](V)j)) —z/(RO(tl(U))), which implies that (c, x) = 
i/(RO(tl(U))), in other words, x G F°P*(RO(t](U))). 


2. F°P*(RO(-)) is upper semi-continuous at tl(U). 

Let T := / X x with elements (a,r, where a G /, r G and ^ G 
Let O be an open set satisfying F°P*(RO(tl(U))) C O. By dehnition, F°p*(RO(-)) is 
upper semi-continuous at tl(U) if there exists some e > 0 such that F°P*(t](V)) C O 
for all t](V) satisfying d[,(t](U), t](V)) < e, where t](V) is a product of compact and 
convex V^. The idea of the proof is to use the fact that F°p*(RO(-)) is upper semi- 
continuous for LSIO problems, then use another RO-LSIO transformation to gain upper 
semi-continuity for RO problems. 


1 . 


c^ti(u)(a,'r, 0 := 


Define the LSIO problem 7r[,(u) := (c, cr[,(u))- Dehne 7rt,(u) := (c, at|(u)), where: 

ifrGl7„,eGM"+S 
(0„,-p) ifr^l7„,eGM"+h 
The proof that vr[,(u) is well-dehned and equivalent to RO(tl(U)) essentially follows 


the same proof as in Theorem 5.2 


2. is upper semi-continuous at Since is equivalent to RO(tl(U)), it 

follows that vr[,(u) satishes the strong Slater condition and is in n^. By Theorem 
7r[,(u) satisfying the strong Slater condition means that F{-) is lower semi- 


2.3 


continuous at (X(,(u)- By Theorem 2.4, lower semi-continuity implies that 
is closed at vrt|(u). Also note that F^(7r[,(u)) is non-empty and bounded because 


7r[,(u) shares the same optimal solution set as RO(tl(U)). Thus, by Theorem 2.4 
is upper semi-continuous at vr(,(u). 


3. With the given O, choose e > 0 such that if F°P*(7rt|(u)) C O, then for all vr 
satisfying 5^(7r, 7rt|(u)) < e, we have F°P*(7r) C O. Such an e exists by dehnition of 
upper semi-continuity at vr[,(u). 


4. Choose tl(V) satisfying dt|(l:](U), 1:](V)) < e and tl(V) has compact and convex V^. 
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5. Define 7r(,(v);^(u) that is equivalent to RO(V). Define 7rt,(v);[i(u) := (c,o'ti(v);t](u)), 
where: 

{ i if r = argmin„g^^rf(^, m), ^ G 14 , 

(On,-p) if r ^ f/„,^ e M’"+^ 

argmin^gy^(i(n, r) otherwise. 

Note that this is a well-defined mapping, since both the argmin in the first and 
third case exist and are uniqne dne to [/„ and 14 being compact and convex. Note 
that every constraint in RO(l:](V)) is inclnded in ai,(v);ii(u) (first case), and that all 
other constraints are either trivial (second case) or redundant (third case). Thus, 
7r[,(v);[](u) is equivalent to RO(tl(V)). 


6- sup„_.,_^ ||a^(u)(a,r,0 - tr^(v);h(u)(a,DOII < sup„g^14) =: d^(4U), ^V)). 

Rewriting cri,(u)(tt, r, ^): 


{ r if r = argmin„g[;^ci(4 n), ^ G 14 , 

(On,-p) if r ^ G 
r otherwise. 

Notice the “otherwise” condition occurs only if t & Ua- 
Then; 

{ min^gc/^ d(4 u) if r = argmin„g^^d(4 n), ^ G 14, 
0 if r ^ G 

d{v, t) otherwise. 


Finally: 

<^^(7ri,(v);h(u), 4(u)) := sup ||o-^(u)(«, r, ^ - a(,(v);^{u)(«, r, 0|| 

Q:,T,^ 


< sup < sup min sup min d{v,T) > 

oe/ [$eVa,TeK"+i msC/c v&Va J 

= SUpdH(f^a,14) 

ael 

=: d^(4U),4V)). 

Since 5’^(7ri,(v);t,(u),7ri,(u)) < e, we have F°P*(^ti(v);[,(u)) 4 C> by step 3. Since 
-^°'’*('^ti(v);ti(u)) = -^°'’*(I^O(tl(V)))) the proof is complete. □ 


Remark 6.4 Note that we used a different RO-LSIO transformation in the proof of the 
second part of Theorem 6^ than the one given in Theorems 3^ and \3.4\ This new RO-LSIO 
transformation would have also worked for the proofs of Theorem 5.1\ and |5.4 however, we 
would have had to use the definition T := I x x and lost some of the geometric 

intuition of those proofs. 

On the other hand, we cannot use the RO-LSIO transformation from Theorems 3.^ and 
3-4 in the proof of the second part of Theorem 6.3. The reason is because the definition of 


upper semi-continuity for LSIO problems is fairly weak in that it does not provide estimates 
for convergence rates. In the proofs of Theorems \5.1 and 5^, we exploited the fact that 
Theorem 2^ had Lipschitz estimates that were invariant for D-equivalent LSIO problems. 
That is, given some r] with ~n choose e sufficiently small so that \v{'k) — 


23 




















z^(7r^(u))| < ^(7r^(u))e < V for all ^^(Tr,7r^(u)) < e, then |z/(7r) - i^(7r^(u))l < < V 

for all 5'^(7r, TT^^u)) ^ ^ri other words, the optimal value function i>{-) is, in some sense, 
“uniformly Lipschitz continuous” on li-equivalent LSIO problems. 

In contrast, LSIO upper semi-continuity at 7rt|(u) states that, for any given open set O, 
there exists a neighborhood 5'^(7r, 7r(,(u)) < e for which each point vr in that neighborhood 
satisfies F°P*(7r) ^ O if F°P*(7rt,(u)) ^ O. Thus, given O and that ~n ^^(u) 

^ O, even if e guarantees F°P*( 7 r) C O for all vr satisfying 5'^(7r, 7rt,(u)) < e, 
it might not be the case that C O for all vr satisfying (5'^(7r, other 

words, the optimal solution set F°p*(-) is, in some sense, not “uniformly continuous”, even 
on U-equivalent LSIO problems. 

Thus, to overcome the lack of an explicit convergence rate in in the definition of upper 


semi-continuity, the new RO-LSIO transformation transfers the machinery of Theorems 3.2 


and 3.4 into the second in the index set T. 


7 Lipschitz continuity of the e-optimal solution set 
7.1 Set and function distance notation 


The notation in this snbsection is taken from Attonch and Wets 1993 and Rockafellar and 


Wets 2009 


For any given r > 0, define the set {A)r := (An rB); recall that B is the unit 
ball. For two sets C and D, subsets of Euclidean space, define the “excess of C on D” as 
e((F, != sup,^^(^ d(^x, yf where d(^x, y'^ is the Euclidean metric. Note that dH{C,D) = 

max{e{C, D), e{D, C)} . We define the following metrics, which are extensions to the Haus- 
dorff distance, as in Rockafellar and Wets | 200 ^ . 


Definition 7.1 (Set distance definitions) LetC and D be two non-empty sets andr > 0. 
Define the following metrics dr{C, D) and dr{C, D): 


dr{C,D) := m.vvx\d{x,C) — d{x,D)\, 

llxll <r 


dr{C, D) := inf < 77 > 0 


C n rB C D + rjB 
D n rB C (7 + TjB 


(18) 


= max{e((C)„C),e((D)„C)}. (19) 


The two different definitions of the set distance d^ given in (19) are given in Rockafellar and 


Wets f2009l and Attouch and Wets f 19931, respectively, and can be shown to be equivalent. 


We also define the following metric related to the epigraph distance between functions, 
as defined in Rockafellar and Wets |2009|. 


Definition 7.2 (Function distance definitions) Let fi and f 2 be two extended real-valued 


24 
































functions. Define the following measures of distance: Sr{fi,f 2 ), ^r(/i,/ 2 ) (ind Sf{fi,f 2 ): 


Wi,f 2 ) ■= d^(epi/i,epi/ 2 ), 

Sr{fi,f 2 ) ■= d^(epi/i,epi/ 2 ), 

min /2 < niax{/i(a;), —r} + rj 

min fi < max{/2(a;), — r} + rj 

B(x,ri) 

where epi/ := {(x, a) G M" x M ; a > f{x)}. 

Definition 7.3 (e-minimizers of a function) Define the set of e-minimizers of a function 
f as: 

e-argminf := {x G M" /(x) < inf / + e}. 


Vx G rB 


Kifuh) ■= inf < r; > 0 


7.2 Lipschitz continuity of the e-optimal solution set for LSIO prob¬ 
lems 

Before we show Lipschitz continuity of the e-optinial solution set for RO problems, we first 
establish an analogous Lipschitz continuity result for LSIO problems, which is the focus of 
this subsection. Next, we state and prove Lemmas 7.4 and|7.5[ which combine different results 


from Rockafellar and Wets [2009 and apply them to LSIO problems. Lemma 7.4 relates the 
distance between e-optinial solution sets with the distance between feasible solution sets and 
Lemma ( tH relates the distance between feasible solution sets and the (5'^-distance between the 
LSIO problems. Combining Lemmas 7A and m gives us the required Lipschitz continuity 
of the e-optinial solution set for LSIO problems. 


Lemma 7.4 (Distance between e-optimal solution sets via feasible solution sets) 

Suppose TTi := (c, cxi) and 7i2 ■= (c, CT 2 ) are LSIO problems such that there exists anro > 0 such 
that r^B O F°P*(7ri) 7^ 0 and r^B fl F°P*(7r2) 7^ 0 and > —uq and h'{7i2) > —To- Define 
the extended real-valued functions /i(x) := (c, x) + XF{ai){x) and f 2 {x) := (c, x) + XF(a 2 ){af), 
where x is the characteristic function. Then, for all r > r^ and for all e > 0.' 

d^(e-argmin/i,e-argmin/ 2 ) < (l + 4re“^)(l + i|ci|)dr(F((Ti), ^((Ta)). 


Proof: The outline of the proof is as follows. We first construct unconstrained convex func¬ 
tions fl and O w hose e-minimizers coincide with e-optimal solutions of tti and 712 . Next, we 
use Theorem 2.5 to obtain an inequality relating dr(e-argmin/i, e-argmin/ 2 ) to the epigraph 


distance {fi , /a)■ Finally, we use Example 7.62 and Proposition 4.37 from 
to further bound Sf{fi, /a) by d,.(F(cri), ^(cTa)). 


Wets 


2009 


Rockafellar and 


1. Define /i(x) := (c, x) -|- XF{ai){x) and f2{x) := (c, x) -f Xf(o- 2 )(^)- W^e will show that fi 
and /a are proper, lower semi-continuous, and convex functions and that the minimizers 
(and e-minimizers) of fi and /a coincide with the optimal (and e-optimal) solutions of 
TTi and TTa. 
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Since F{ai) and F{a 2 ) are non-empty, there exist x and x' such that fi{x) < -|-cx) and 
/ 2 (x') < -|-oo. Thus, /i and /2 are proper functions. 


By Theorem 1.6 from Rockafellar and Wets 2009| , fi and /2 are lower semi-continuous 
if and only if lev<a/i and lev<a /2 are closed for all a G M, where 

lev<Q,/j := {x G M” : fi{x) < a} = {x G F{ai) : (c, x) < a}, for i = 1,2. 

Let foi{x) := (c,x), and note that /oi is continuous on M"', and so /q^^((— cxd, a]) =: 
lev<Q/oi is closed. Since F{ai) is closed, lev<a/i = F{ai) fl lev<a/oi is closed. The 
proof for lev<a /2 is identical. 


Note that the characteristic function xa is convex if A is convex. Thus, fi and /2 are 
convex because they are the sum of convex functions. 


Finally, by construction, the minimizers (and e-minimizers) of fi and /2 are exactly 
the optimal solutions (and e-optimal solutions) of tti and 7r2. This equivalence follows 
because /i(x) = -f-cx) whenever x ^ F{ai) and f 2 {x) = -f-cx) whenever x ^ F{a 2 ), 
and so minimizing fi and /2 is the same as minimizing (c,x) over F{ai) and F{a 2 ), 
respectively. 


2 . 


Use Theorem 2.5 to 


get: 


d,,(€-argmm/,,e-argmm/2) < (l + 4 r€ ')V(/i>/2) 


( 20 ) 


for all r > Tq. 


We apply Theorem 2.5 to fi and / 2 . Theorem 2.5 requires that fi and /2 are proper. 


lower semi-continuous, and convex functions, which was shown earlier. The other condi¬ 


tions in Theorem 2^ are satisfied by our assumptions, and the fact that the minimizers 
of fl and /2 coincide with the optimal solutions of tti and 7r2, so that fi and /2 satisfy 
argmin/i ft roB ^ 0 and argmin /2 fl tqB 7^ 0 and min/i > —tq and min /2 > —tq. 


3. Use Example 7.62 from Rockafellar and Wets ^20091 to get: Sf{fi,f 2 ) < (l-|-||c||)dr(F((Ti), F((T 2 )). 

We apply the results of Example 7.62 from Rockafellar and Wets |2009| to fi and / 2 , by 
setting (c, x) h->• /oi = / 02 , F{ai) 1 —)■ Ci and F{a 2 ) e-)■ 02- For any r > 0 the constant 
Ki{r) from Example 7.62 can be chosen uniformly to be ||c||, since /oi = /02 = (c,x) 
so that |(c,x) — (c,x)| < ||c||||x —x|| by the Cauchy-Schwarz inequality. Furthermore, 

/oi = /02 so that \foi{x) — fo 2 {x)\ = 0 for all x. Thus, for all 0 < r < r' < -|-cx and 
dr(F(ai),F(a 2 )) < r' - r: 

F(/l,/2)<(l + l|c||)a,(F(<Ti),F(<72)). 

If we apply Proposition 4.37 parts (a) and (c) from [Rockafellar and Wets 2009 
obtain 


we 


d,.(F((Ti), E((T 2 )) < d 2 .(F((Ti), ^( 0 - 2 ))) < max{d(0, E((Ti)), d(0, ^(cra))} -h r. 

Thus, for any r > 0, by choosing r' := max{(i(0, F((Ti)), <7(0, F(ct 2 ))} -|- 2r, it follows 
that: 

F(/i./ 2) < (1 + l|c||)d2(F(ffi),F(ff2)). (21) 


4. Combine the inegualities. Using the inequalities (20) and (21) it follows that; 

d,.(e-argmin/i,e-argmin/ 2 ) < (1-F 4re“^)(l-h ||c||)d,.(F(cri), F(a 2 )), 


26 































for all r > tq. 


□ 


Lemma 7.5 (Distance between feasible solution sets) Let ttq := (c, uo) G int(n/) be 
given. Let r] satisfying 0 < rj < S^(ao, Sj) be given. For all ai, <72 G Sj- satisfying 5^(cri, Uo) < 
1 ] and S^{a 2 , erg) < rj, the following ineguality holds for tti := (c, Ui) and tt 2 '■= (c, ( 72 ) and for 
all r > 0: 


MF{cTi),F{a2)) < 



HM) \ 

5^(c7o,Si) -r]) 


5"(7ri,7r2) 


(1 + r)y/l + 
(5^((7o,Si) -r] j 


6^{TTi,Tr2). 


Proof: For brevity, write F{ai) and F{a 2 ) as Fi and F 2 , respectively. By (19), dr(Fi, F 2 ) := 
max{e{{Fi)r, F 2 ), e{{F 2 )r, Fi)}. We will show that both e{{Fi)r, F 2 ) and e{{F 2 )r, Fi) are 
bounded by sup^g^^ ^ 2 )- We will only prove this inequality for e((Fi)j,, F 2 ), 

and omit the analogous proof for e{{F 2 )r, Fi). Let rj satisfying 0 < r] < (5^((7o,Sj) and 
(7i, (72 G S/- satisfying ^^((7i, (7o) < rj and (5^((72, erg) < rj he given. 


1. First, (7i,(72 G int(Sj). By assumption, ag G int(Sj). By Corollary 1 from Canovas 
, since ag G Sj, we have (5^((7o,Sj) = (5^((7o,bd(Sj)). Suppose to the 


et ah 


2005 


contrary that, (7i G bd(S/). Then by dehnition 5^((7o,bd(E/)) < 5^((7i,(7o) < rj < 
d^(crg, Sj) = 5^(cro, bd(E/)), which is a contradiction. The same reasoning holds for (72. 

2. Let G Fi be given. Then sup^ig^^prs -^ 2 ) < sup^ig^^prs 

Apply Corollary 4.1 from Canovas et ah |2006b| with (7i h-)■ ag (ag in this instance 
referring to the ag in that Corollary) and (72 a, with the required assumption that 
(7i,(72 G int(Sj) being satished. Thus, for any G Fi, we have 


-5^(c7i,C72). 


i)^(a2,S.r 

In particular, this inequality holds for any z^ G Fi (1 rB: 


S^(ai,a2). 


( 22 ) 


sup d{z^,F 2 )< sup 

^leFiOrB z^&FinrB 0 (a2,ZJi) 

3. Then e((Fi)^, F2) < sup^g^^ ^2)- 

The left hand side of (22) is precisely the dehnition of e((Fi)r, F 2 ). The right hand side 
of (22) is at most the supremum over ^ G rB: 

e((Fi)r,F 2 ) < sup ,5^(ai,a2). 

z&rB 0 ((72, hj) 

4 . Finally, e((Fi)r,F2) < sup^g^^; ^2)- 

We hrst show that S^(a 2 , Sj) > S^(ao, Sj) — t]-. 

(5^((72,Sj) := inf ^^(c72,ct')= inf S^(a',a 2 ) 

> inf ((5^((7', (To) - (5^((7 o, CT 2 )) 

o-'eSi 

> Si) - I), 
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(25) 

























where (24) follows from the triangle inequality and (25) follows because (5^((To,Sj) := 
info-'eSi^(o'', cTo) and S^{ao,a 2 ) < rj. Since tti and tt 2 have the same cost function, 
8'^{(yuCF2) = 5 ^{'Ki,'K2). 


5 . Then, d^(F(ai), ^(as)) < (sup^g^g s^tT£)-v ) ^^{711,712). 

The proof of e{{F2)r, Fi) < sup^g^g ^2) follows by interchanging the 

roles of (Ti and a 2 in the previous steps. Thus we obtain the inequality dr(F(cTi), F(ct 2 )) < 
^sup^grB ^ 2 )- The equality follows by the dehnition and monotonic¬ 
ity of t/’dl^ll) and that ||z|| < r for z G rB. □ 


Theorem 7.6 (Lipschitz continuity of the e-optimal solution set for LSIO problems) 

Let tiq := (c, cxo) G int(nj) be given. Let rj satisfying 0 < rj < (5^((To,Ej) be given. Suppose 
TTi := (c, (Ti) and 7^2 '■= (c, CT 2 ) are LSIO problems with the following properties: 

1 . ( 5 ^((Ti,cto) < p and S^(a2,o'o) < p. 

2 . There exists an ro > 0 such that vqB n F°P*(7ri) 7^ 0 and r^B n F°P*(7r2) 7^ 0 and 
I'iji) > —ro and 17(772) > —vq. 

Define the extended real valued functions fi(x) := {c,x) + XF{ai)(x) and f2(x) := {c,x) + 
XF(a2)(^)- Then we have, for all r>ro: 

d^(e-argmin/i,e-argmin/ 2 ) < (1 + 4re“^)(l + ||c||) ( ) 5^(fi,F2). 


Proof: The result follows from the direct application of Lemma 7.4 and 7.5 


□ 


Theorem derived by combining variational analysis and LSIO results in the literature, 
provide new insight into the quantitative continuity of e-optimal solution sets, supplementing 
the results in Canovas et ah |2006b for optimal solution sets. 


7.3 Lipschitz continuity of the e-optimal solution set for RO prob¬ 
lems 


Using Theorem 7.6 
RO problems. 


we can now prove Lipschitz continuity of the e-optimal solution set for 


Theorem 7.7 (Lipschitz continuity of the e-optimal solution set for RO problems) 

Let RO(tl(U)) be a RO problem of the form (|^ with non-empty compact and convex uncer¬ 
tainty set Ua in each constraint, indexed by a & I, with fixed cost function c. Suppose that: 

1. RO(tl(U)) satisfies the strong Slater condition, with strong Slater constant p > 0, 

2. F°P*(RO(tl(U))) is non-empty and bounded, 

3. sup{—6",a G /} < -|-oo. 
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Define the LSIO problem € int(ns), where: 


o'[i(u)(t) - cT[,(u)((a,t, s)) 


{t, s) if {t, s) e Ua, 
(On, -p) if {t, s) ^ Ua- 


Let r] > 0 satisfying 0 < rj < (5'^(7rt,(u),bd(ns)) be given. Let tq > 0 satisfy r^B fl 
e-argmin(RO(tl(U))) ^ 0 and i/(RO(tl(U))) > —vq. Suppose tl(V), with compact and convex 
uncertainty sets satisfies the following conditions: 

1 . 4 (^(U)J(V)) < ,,, 

2. vqB n e-argmin(RO(l:](V))) 7^ 0, 

3. z/(RO(^(V))) > -ro. 

Then, for all r > vq: 

dr (e-argmin (RO (t] (U))), e-argmin (RO (t] (V)))) 

/ (1 + r)Vl + H 

Remark 7.8 We may replace the set of conditions on 1:](V) with the two conditions: 

1. d,(|,(U).l|(V))<min{„,«^}. 

2. roB n e-argmin(RO(t](V))) 7^ 0. 

The condition (i(,(tl(U), tl(V)) < min jr;, | replaces conditions 1 and 2 in Theo¬ 

rem because we can apply Theorem |5.^| to guarantee: 

KRO(^(U)))-KRO(^(V))) < L(7r^(u),r/)cia^(U),^(V)), 

< z/(RO(^(U)))+ro, 

and hence z/(t](V)) > —ro. 


< (1 + 4re )(1 + ||c 


da^(U),^(V)). 


Proof: The steps of the proof are almost identical to that of Theorem 5 . 2 , with the only 
major difference in that we have to apply Theorem 7T in place of Theorem 2^ All the steps 
of the proof are shown in the same way as in Theorem 5.2 □ 


8 Conclusion 

In this paper, we showed that robust linear optimization and robust LSIO is continuous 
with respect to perturbations in the uncertainty set. In particular, by constructing an ex¬ 
plicit RO-LSIO transformation, we showed that the optimal value and e-optimal solution set 
mappings are Lipschitz continuous, which are novel quantitative stability results for robust 
optimization. We also showed that the optimal solution set mapping is closed and upper 
semi-continuous under less restrictive conditions on the uncertainty set compared with pre¬ 
vious results in the literature. In addition, the robust LSIO stability results may provide 
insight to understanding stability for general robust convex optimization. 
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A Facts about sets of LSIO problems. 


Remark A.l (Non-emptiness of constraint sets and problem sets) The setsT,f, bd(S/) 
and Sj are non-empty. Furthermore, the sets 11/, bd(n/), Ilj, and are non-empty. 

Proof: Consider constraint system cxo with (0„, 0), that is, (0„, x) > 0, as the only constraint 
(up to some multiplicity). Note that cxo is in both S/ and bd(S/); the latter inclusion is 
obtained by recognizing that the constraint systems with (0„, x) > e as the only constraint 
satisfy G Sj for any e > 0. The fact that G Sj for any e > 0 also shows that Sj is 
non-empty. 

The same examples with the cost function c = 0„ for all of them prove that 11/, bd(n/), Ilj, 
and are non-empty. □ 


Remark A.2 (Distance to IIoo) The following hold: 

cr Gcl(S/) cr ^ Soo 

TT G cl(n/) TT ^ IIoo. 

Proof: We prove the hrst statement. By Corollary 1 from Canovas et ah [2005 , if cr G 

S/ then (5^((j, Sj) = (5^((j, bd(S/)). Remark 2 from Canovas et ah [2005 states -|-oo > 

(5^((T, Sj) = (5^(cr, bd(S/)). Thus, by definition, a ^ Soo- If a G bd(S/), then by definition 
a ^ Soo- 

We prove the second statement. If tt := (c, a) G 11/, by definition, a G S/. By the first 
statement, a ^ Soo- By definition, 

(5"(7r,bd(n/)) := inf 5^(7r,7r') = , , inf max{||c - c'||, (5^(a, a')}. 

7r'Gbd(ny) 7r':=(c',(j')Gbd(ny) 

Consider the restricted subset of points in bd(n/) such that vr' = (c, ex'), i.e. the problems 
with all the same cost function as tt, which we denote bd(n/) fl {vr' : c' = c}. Then: 

5'^(7r, bd(n/)) = inf max{||c—c'||, 5 ^(ct, cr')} < inf max{0, (cr, cr')}. 


7r':=(c',cr')Gbd(n/) 


7r'Gbd(n/)n{7r' : c'=c} 


(26) 

The last term in (26) is the same as (5^(cr, bd(S/)). Since (5^(cr, bd(S/)) < -fex), it follows 
that 5’^(7r, bd(n/)) < -1-cx). Thus, by definition, tt ^ Boo- If vr G bd(n/), then by definition 

TT ^ Boo- □ 


B Proofs of lemmas in Section ^ 
B.l Proof of Lemma 


4.3 


Lemma 4.3 (Distance to ill-posedness) If ir := (c, (Jq) G B/, then 

5^(cro,E,) = d(0„+i,bd(R(cro))). 


Remark B.l Note that in Canovas et al. 1200^ , refers to “strongly infeasible”, which 
conflicts with the notation of B^ which refers to “solvable”. For the remainder of this proof, 
we will use Hgi to denote strongly infeasible to distinguish it from B^. The set of strongly 
infeasible problems refers to the systems which contain a finite subset of constraints that is 
infeasible. With this definition, it is clear that is non-empty, because the constraint system 
with (0„,x) > 1 as a constraint is strongly infeasible. For brevity, write R(cro) as H. 
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Proof: All we need to show is that (5^((To,Si) = (5 ^((To, bd(Ssj)), because (5 ^((To, bd(Ssj)) = 
(i(0n+i, bd(if)) follows from Theorem 6 in Canovas et ah |200^ . 

First, we show ^^(cTo,Sj) < ^^(cro,bd(Ssi)). Since T,si C Ej, 

_ ^^(CTO, s,) < 5^(ao, S,,). (27) 

By Corollary 1 in Canovas et ah 1 12005] , since do ^ C S, 

= <5^(ao,bd(S,,)). (28) 

Thus, 

5^(ao, E,) < <5^(ao, E,,) = 5^(ao, bd(E,i))^ _ (29) 

To prove the reverse inequality, first note that by Corollary 1 in Canovas et ah 2005], 

5^(ao,E,)=5^(ao,bd(E^)). (30) 

For all a G bd(Ej), we have a ^ Eqo by definition. Thus, by Theorem 5 part (iii) from 
Canovas et al. (2005) , for all a G bd(Ej), we have a G bd(Esj). This means that 

<5^(cro,bd(E/)) > 5^(cro,bd(E,,)). (31) 

□ 


Remark B.2 This lemma gives us a way to calculate the quantity S^(ao, Ej) in a less abstract 
space. 


B.2 Proof of Lemma 


4.4 


Definition 4.2 (Constants from Canovas et al. |2006b| ) ForanyTTo := (c°,cro) G int(ns), 
define the following quantities for 0 < e < 5^^(7ro,bd(ns)).- 


V7(A) = (p*(A) 
fj{a) 

p(7ro) 


/3(7ro,e) 

7(7ro,e) - 

/i(7ro,e) := (p(0) 


yiTP, 

(1 + a)VY+~ofi, 
sup Rijo) 

d*(0„,bd(Z-(7ro)))’ 

^(p(7ro)) 


5^(cro,Ei) - e’ 

</9*(0)(p(7ro) + e/?(7ro,e)) + ||c°||*/?(7ro, e), 
sup i?(7ro) + e max{l, 7(7ro, e)} 


L(7ro,e) := v?*(0) (e + ||c' 


d(0n,bd(Z (7ro)))-e 

oin ^(/^K,e)) 


(5^(ao,Ei) -e 


+ h(7roT) 


Lemma 4.4 (Constants in Definition 4.2 are well-defined) For any tto := (c°,(To) G 
int(n 5 ), we have: 

1 . d(On+i,bd(i7(cro))) > 0, 

2. d(On,bd(2'"(7ro))) > 0, 

3 . <5n(7ro,bd(n,)) >0, 


f. Let any 0 < e < (5'^(7ro, bd(ns)) he given, then (5^((To, Ej) > e. 
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In particular, all the values in Definition \4.^ are well-defined for 0 < e < ^’^(Tro, bd(ns)). 

We prove each of the points individually: 

Proof: 


1. The required statement is equivalent to proving 0„+i ^ bd(W(cro)). By Remark A.2 


that if TTo G n\noo, then 0„+i G ext(W((Jo)) if and only if ttq 
TT o G int(ns) C int(n/), we immediately have 0„+i G ext(-ff(cTo)). 


TTo ^ Boo, since tiq G int(nj). Proposition 2(ii) from Canovas et al.| |2006a| states 


G m 


t(nj). Since 


2. The required statement is equivalent to 0^ ^ hd{Z (vto)). Proposition 3(i) from Cano¬ 
vas et ah |2006a| gives 0„+i G int(Z“(7ro)) if and only if ttq G int(n 5 ). 


Theorem 2 from Canovas et ah |2006a| states that if tt G 01(11^), then (5^(7ro, bd(ns)) = 
min{(i(0„+i, bd(if (cTo))), (i(0n, bd(Z“(7ro)))}. Note that tt G int(ns) C cl(ns). Thus, 
by the previous steps, (5'^(7ro, bd(ns)) > 0. 


4. 


Let e be such that 0 < e < W(7ro, bd(n 5 )) be given. By assumption, tto G fhj, so 
that (To G Sj. Then, by Theorem 2 from Canovas et ah |2006a| , (i(0„+i,bd(iL((To))) > 
(5'^(7ro, bd(ns)), noting that ttq G int(ns) C cl(ns). Lastly, from Lemma 4.3, we have 
(5^((To,Si) = ci(On+i,bd(iL((To))) > (5"(7ro, bd(n 5 )) > e. 


5. For the “in particular” statement, we need only check that the denominators are non¬ 
zero and that n(7ro) is finite. Since we are using the Euclidean norm, (i*(0„, bd(Z“ (vto))) = 


d{0n, hd{Z (ttq))). Now, d( 0„,bd(Z (tto))) > (5^(7ro, bd(ns)) > 

|2006a| . Also, (5^((To,Sj) > e > 


e > 0 due Theorem 2 
0 due to the fourth statement. 
Lastly, since ttq G int(ns), the optimal value n(7ro) is finite. □ 


from Canovas et ah 


c 


Proof of Theorem 


5.2 


Theorem 5.2 (Lipschitz continuity for multiple-constraint RO) Let RO(tl(U)) be a 
RO problem of the form (|^ with non-empty compact and convex uncertainty set Ua in each 
constraint, indexed by a E I, with fixed cost function c. Suppose that: 


1. RO(tl(U)) satisfies the strong Slater condition, with strong Slater constant p > d. 


2. F°P*(RO(tl(U))) is non-empty and bounded, 


3. sup{—6 “,q; G /} < -hoo. 

Then, there exists a LSIO problem G int(n 5 ), where: 


o'[i(u)(t) - (T[,(u)((a,t, s)) 


(f, s) if {t, s) G Ua, 
(On; p) if {t, s') ^ Ua, 
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such that for any e satisfying 0 < e < (5’^(7r[,(u), bd(ns)), and for all t](V) C x M) 

with compact and convex Va satisfying sup^^j dH{Ua,Va) < e, we have: 


z/(RO(^(U))) - z/(RO(^(V)))| < mV), 6)d^(^(U), ^(V)). 


The Lipschitz constant L(t](U),e) 
•= (c, cr[,(u)) dn-d the given e. 


L{^^^^(^upe) can be calculated via Definition f.2 using 


Proof: Let T := J x x M. Denote the elements t G T as tuples t := (a, t, s) where a E I, 
t eW and s G M. 


1. Write RO(t](U)) as the LSIO problem 7r^(u)- First, we show that and RO(t](U)) 
are equivalent. Note that the cost functions for the two problems are the same, and that 
7r[,(u) contains all the constraints of RO(tl(U)) plus some additional trivial constraints. 
Thus 7r[,(u) and RO(l:](U)) have the same feasible solution set, optimal value, and op¬ 
timal solution sets. Furthermore, since RO(tl(U)) satishes the strong Slater condition 
with Slater constant p, and since (0„,a:) > —p -|- p = 0 for all x, it follows that vrt,(u) 
satishes the strong Slater condition with Slater constant p. 


Second, we show that vr[,(u) G int(ns). By assumption, F°P*(RO(t](U))) is non-empty 
and bounded, so F°P*(7r[,(u)) is non-empty and bounded. Since 7rt,(u) satishes the strong 

2.3, we have vrt,(u) G int(n/). 

2006c| , c G int(cone({at ; t G 


Slater condition, by Theorem 
part (vi) from Canovas et al 


Thus, by Proposition 1 
T})), and by part (vii). 


this implies that ^ int(ns 


2. Choose tl(V) in an e-neighborhood of tl(U). Let e > 0 be given satisfying 0 < e < 
(5'^(7rt,(u),bd(ns)). Such an e exists because 5^(7r(,(u),bd(ns)) > 0 by Lemma 
Let t](V) be any compact and convex set in M"' satisfying (it,(l:](U), tl(V)) < e < 
(5'^(7rt,(u),bd(ns)). Such a 1:](V) exists; e.g., the choice Va := Ua + B{0,e/2) for all 
a E I satishes (i(,(t](U), tl(V)) < e. 


4.4 


3. 


Define 7r[,(u);^(v) (d c’';i(U);;i(v))- Dehne the LSIO problem 7rt,(u);[](v) (c, o'i,(u);^(v)) 

By the same theorem, 7rt|(u);^(v) is well-dehned. Since for each a E I, 
Va\Ua, Ub) , s)) is an element of l:i(U), every constraint 


as in Theorem 3.4 


in 7r[,(u);[i(v) is in and vice versa. Thus, 7r^(u);[](v) ~n Furthermore, since 

7i't](u);ii(v) ~n and vr[,(u) satishes the strong Slater condition with the Slater constant 
p, it follows that vr[,(u);t](v) also satishes the strong Slater condition with constant p > 0. 


4. 


Define vr[,(v);^(u) : = 


as in Theorem 3.4 
RO(^(V)). 


(c, crt,(v);^(u))- Dehne the LSIO problem 7rt,(v);[,(u) := (c, o'li(v);h(u)) 
By the same theorem, vr[,(v);i:(u) is well-dehned and is equivalent to 


5. 

6 . 


By Theorem 3.fi 5"(7r^(u);^(v), vr^(v);^(u)) = d^(^(U), ^(V)) := sup^g^ 14) < e. 


Apply Theorem 2.2 with 7r[,(u).^(v) 7ro,7ri and 7r^(v);[i(u) 712 . We check that the 

assumptions of Theorem |2.2| are satished: 


(a) 7ri,(u);^(v) £ int(ns). This proof is identical to the proof that G int(ns), given 
in Step 1. 
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(b) e < 5^(7r^(u);^(v),bd(n 5 )). Recall that 7rt,(u);[](v) and 7rt,(u) are both in int(ns), 

have non-empty bounded optimal solution sets and are Il-equivalent to each other. 
Thus, we have e < 5'^(7r(,(u), bd(ns)) = bd(ns)), where the inequality 

is by assumption and the equality is by Lemma |4.5[ 

(c) 5^(vri,(u);^{v),7ri,(v);^(u)) < e <^"(7rt](u);^(v), 7rt,(u);[](v)) = 0 < e. The first inequal¬ 
ity comes from Step 5, and the second inequality is trivial. 


Thus, the assumptions of Theorem |2.2| are satisfied, so: 

l'^(’^ft(U);l](V)) - '^(^ll(V);h(U))l < r(7r,(u);^(V). (’rtl{U);ft(V).’r|l(V);ft(U)), 


(32) 


where L(7rt,(u).[,(v), e), as defined in Definition 4.2 


7. Lastly, show that the Lipschitz constant is independent of the choice of V. Applying 


Lemma 4.5 to Ll-equivalent problems and vrt|(u);ti(v )5 h follows that L(7r[,(u),e) = 


-^(7ri,(u);Kv),e)- Now define L(^(U),e) := L(7ri,(u), e). By recognizing that z/(7r^(u);[,(v)) = 
z/(RO(^(U))) and i/(7r^(v);^(u)) = i^(RO(^(V))), and using 5"(7r^(u);^(v), 7r^(v);h(u)) = 
d_H'(l:i(U), tl(V)), we obtain the final result: 

|z/(RO(^(U))) - z/(RO(t](V)))| = |i^(7rt,(u);[,(v)) - i^(7ri,(v);ii(u))|, 

(By definition of and 7rt,(v);[)(u)) 

< L(7r[,(u);[,(v), e)^^(7ri,(u);[i(v), vri,(v)i[,(u)), 


(By Theorem 2.2) 


- -^(7rt](u);[)(v), e)dH(tl(U), l:i(V)), 


(By Theorem 3.4) 


= L(^(U),e)dH(^(U),^(V)). 
(Since 7r[,(u);i,(v) ~n 7ri,(u)) 


□ 


D Summary of Notation 

Notation used in this paper is summarized in Table [Tj 
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Notation 


Name 

cost vector 
coefficient vector 
right-hand side 


Definition 


c G R’ 
a-.T - 
b-.T - 


T 

TT 

a 

n 

_E_ 

d{x,y) 

d{x,C) 


index of LSIO problem 
LSIO problem 
constraint system 
Set of LSIO problems 
Set of constraint systems 
Dist. b/w points in R" 

Dist. b/w a point and a set 


TT := (c, {a,b)) 
a := (a, b) 
n := R" X (R” X ■ 
S := (R" X R)^ 

infyec d{x, y) 


e{C,D) 

dH{C,D) 

Ar{C,D) 

Ar{C,D) 

d^(^(U).^(V)) 

Sr{fl,f2) 

5+(/i,/2) 

S^{'Xi,n2) 

F{o) 

v(ti) 

F°P*{n) 

A{ti) 

m 

z-{^) 

H{a) 

Si 

Soo 

n/ 

n. 

n. 


Excess of C on D 
Hausdorff distance 


inf < r; > 0 


distance b/w cti and 02 

distance b/w tti and 712 
feasible solution set of tt 
optimal value of tt 
optimal solution set of tt 


suPxeC infyeD d{x, y) 
max < sup inf ||m — u||, sup inf ||m — u 

\^u€.U v^V v^V u€.U 

max||^ll<p \d{x, C) - d{x, D)\ 

C n pB C D + rjB 
D n pB C C + pB 

sup^^i dniUcVc) _ 

dr(epi/i,epi/2) 

dr(epi/i,epi/2) 

min /2 < max{/i(a;), -p} -f p 

B{x,ri) 

min /i < max{/2(a;) — p} + p 

B{x,ri) 

a^{t) \ ( a^(t) 


:= max{e((C)r, D), e((D)r, C)}. 


inf < 77 > 0 


\fx G pB 


(5^((71,(72) := SUPjgj, 


m 


m 


set of feasible a 
set of infeasible a 

set of feasible n 
set of infeasible tt 

set of solvable n 


5 ^( 771 , 712 ) := max{||c^ - c^||, 5^((7i, ( 72 )} 
F{a) := {a: G R" : {at,x) > h, Vt G T} 
7 /( 77 ) := infj,gi{~{(c,x) : x G F{a)} 

E°P‘(7r) := {x G R" : (c, x) = 7 /( 71 )} 
hl(7i) := conv({ai,t G T}) 
rItv) := {-bt,t G T; 7 /( 71 )} 

Z^(n) := conv({at, t E T; —c}) 

_ (:)}J "{(-;■ 

S/:={(7GE : F{a)^0} 

Si := S\S/ 

S„c := {(7 G S : 5^((7,bd(S/)) = -boo} 

11/ := {71 = (c, ( 7 ) G n : (7 G S/} 

Hi := n\n/ 

:= {71 G n : S^{Ti,hd{Uf)) = -b(X)} 
rij := {71 = (c, ( 7 ) G n : _F°p‘(7i) ^ 0} 


FI (a) := conv 


M>0 


R0([/) 

mom 

7/(R0([/)) 

E°p‘(RO( 17)) 

(b>(A) 

tp{a) 

pm 

/3(7ro,e) 

7 ( 770 , e) 
M(77o,e) 
L(77o,e) 


RO with unc set U 
teas set of RO problem 
opt value of RO problem 
opt set of RO problem 


RO([/) := {c,U,b) 


ip{X) = ipt{\) := \/l -f A2 
tp{a) := (1 + a)\/l + oF 

Ffxr i- supJ{(jro) 

P\“ 0 ) ■ d,{ 0 „M{Z-{iro))) 

7(770, e) := v 5 .(OKp( 77 o) + + l|c“ 

M(-o,e) 


Lipschitz constant 


L(77o,€) := m) (^(. 


e-b c" 


\ ipM-xo,i:)) 

7 52(,to,E,)-6 


\*pm 


■ 17(770, e)) 


Table 1; Summary of notation. 
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